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Based on a thermodynamic analysis of the kinetic model for the protein phosphorylation- 
dephosphorylation cycle, we study the ATP (or GTP) energy utilization of this ubiquitous 
biological signal transduction process. It is shown that the free energy from hydrolysis 
inside cells, AG (phosphorylation potential), controls the amplification and sensitivity of 
the switch-like cellular module; the response coefficient of the sensitivity amplification ap- 
proaches the optimal 1 and the Hill coefficient increases with increasing AG. We discover 
that zero-order ultrasensitivity is mathematically equivalent to allosteric cooperativity. 
Furthermore, we show that the high amplification in ultrasensitivity is mechanistically 
related to the proofreading kinetics for protein biosynthesis. Both utilize multiple kinetic 
cycles in time to gain temporal cooperativity, in contrast to allosteric cooperativity that 
utilizes multiple subunits in a protein. 
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1 Introduction 



Biological signal transduction processes are increasingly being understood in quantitative and modular 
terms Q|2l. One of the most commonly studied modules of cellular "circuitry" is the phosphorylation- 
dephosphorylation cycle (PdPC) |3| which has been shown to exhibit sensitivity amplification for the appro- 
priate stimuli expressed through activating a kinase or inhibiting a phosphatase (4l|5l|6l. Both experimental 
measurement Q IH ID and theoretical modeling have shown that the covalent modification gives rise to a 
switch-like behavior. 

Sensitivity amplification requires energy consumption l4ir7l fT0ll . Since the PdPC involves the transfer 
of high-energy phosphate group, it is natural to ask how the cellular phosphoenergetics play a role in the 
signal transduction processes. Recently, a novel mechanism has been proposed lITTl for improved Rab 5 
GTPase function as cellular timer |[T2ll by utilizing the energy derived from GTP hydrolysis. It is shown that 
an energy expenditure is necessary for a GTPase timer to be accurate and robust. 

Phosphoenergetics and ATP hydrolysis are also involved in PdPC. While it is known that energy expen- 
diture is required to maintain levels of phosphorylation in excess of an equilibrium l4l lT0ll . it is still not yet 
clear how cellular energetics relates to this type of signal transduction process. One approach to address this 
question is introducing a rigorous thermodynamic analysis into the kinetic models of PdPC 13 HI. The sim- 
plest kinetic scheme for PdPC is shown in Q, which is based on a model proposed by Stadtman and Chock 
m and by Goldbeter and Koshland Q. The essential difference between our Q and the earlier models is the 
nonzero qi and q2, i.e., the reversibility of the separate and distinct phosphorylation and dephosphorylation 
processes. 

In order to carry out a cogent thermodynamic analysis for the kinetic model of PdPC, the reversibility 
of the biochemical reactions involved, specifically the phosphorylation catalyzed by kinase and dephospho- 
rylation catalyzed by phosphatase, must be enforced. While this was known to be an important issue fl3l . 
almost all current models neglect the slow reverse steps. 
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2 Basic Biochemical Equilibrium and Energetics 

We consider a phosphorylation-dephosphorylation cycle (PdPC) catalyzed by kinase Ei and phosphatase 
E2 respectively. The phosphorylation covalently modifies the protein W to become W*: 

W + Ei^ WEi + Ei (/) 

W* + E2% W*E2 ^W + E2. {II) 

It is important to note that the reaction I is not the reverse reaction of II. In fact, recognizing that the 
hydrolysis reaction ATP ^ ADP+Pi exphcitly, we have 

W + Ei + ATP % W -El- ATP ^W* + Ei+ ADP 

W* + E2% W*E2 + E2 + Pi. 

Thus, at constant concentrations for ATP, ADP, and Pi, 

ai=a'i[ATP], qi=q'i[ADPl q2 = ql[Pi]- (2) 

For simplicity we have assumed that these rate constants are pseudo-first order, which implies that ATP, 
ADP, and Pi are sufficiently below the saturation levels for their respective enzymes. 
The equilibrium constant for ATP hydrolysis therefore is 

[ATP]eq ^ diq\d2q2 ^ -ac/rt 
[ADPlgiPiU alkia2k2 

where AG" is the standard free-energy change for ATP hydrolysis reaction fl4V That is "d^q-^^-tql - ^ i'^ 
equilibrium. However, with physiological concentrations for ATP, ADP, and Pi inside cells, the quotient 
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aikia2k2 _ a°kia2k2 f [ATP] \ 
diqid2q2 ~ d,q1d2q"2 \[ADP][Pi]J ' 



is directly related to the intracellular phosphorylation potential 
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where RT = 0.6kcal/mol at room temperature. We shall also introduce an equilibrium constant for the 
dephosphorylation reaction catalyzed by phosphatase under intracellular phosphate concentration: 

^ = 1 • (6) 

The two parameters 7 and fj. are the key augmentations to the model of Goldbeter and Koshland 13. 

We recognize the fact that there is currently no experimental evidence for reaction II being reversible. 
While the backward rate for the dephosphorylation reaction catalyzed by a phosphatase can be extremely 
small, a thermodynamically correct model has to have a nonzero q!^, no matter how small it is. In fact, Eq. |4] 
could be used to estimate the unmeasurable q2 if all the other rate constants are known. 

3 Reversible Kinetic Model for Covalent Modification 

The kinetic equations for the reaction cycle in Q are straightforward 

d[W] 



dt 

d[WEi] 
di 

d\W*] 



dt 

d[W*E2] 



-ai[W][Ei] + di[WEi] + k2[W*E2] - q2[W][E2] 
ai[W][Ei] - {di+ki)[WEi]+qi[W*][Ei] 

-a2[W*][E2]+d2[W*E2] + ki[WEi] - qi[W*][Ei] 
a2[W*][E2] - {d2 + k2)[W*E2\ + q2[W][E2]. 



(V) 



dt 

These equations are solved in conjunction with conservation equations |8j|9l andlTOl 

Wt = [W] + [W*] + [WEi] + [W*E2] (8) 
EiT = [Ei] + [WEi] (9) 

E2T = [E2] + [W*E2]. (10) 

Following the elegant mathematical treatment given in |5|, we have the steady-state fraction of phosphory- 
lated W, denoted by W* = [W*]/Wt as in | 5], satisfying 

a^[^,-{^, + l)W*]{W*-K,-l) 

[^i-^-{^i^ + l)w*]{w* + K2) 
4 



Here we have denoted 



kiEiT ^. di + ki d2 + k2 

0- = , ^ , Ki = -— , K2 



k2E2T aiWx a2WT 

These three parameters are in the original model Q which, by assuming irreversible reactions with qi = 

q2 = 0, has /x = and 7 = cxd. a represents the ratio of kinase activity to phosphatase activity. Hence 
it characterizes the magnitude of the stimuli for the PdPC. 1/Ki and I/K2 are the ratios of substrate con- 
centrations to the Michaelis-Menten constants of kinase and phosphatase, respectively. A small K 1) 
means the enzymatic reaction is highly saturated. 

More explicitly, Eq. [njis a quadratic equation for W*: 

AW*"^ - BW* + C = 0, (12) 

in which 

A = 1 + n- a (1 + — 



7/^ 

)-a(l-K2(l + 

7/i 



B = n + {l + n){l + Ki)-a[l- K2II + — 



C = + Ki) + aK2. 
The steady-state solution to Eq. therefore, is the positive root of Eq. [l2l 

It is plotted in Fig. 1 using Ki = K2 = 0.01, i.e., both enzymes are highly saturated thus the rates are only 
weakly dependent on the respective substrate concentrations O, and /x = 10~^, i.e., the dephosphorylation 
reaction is highly irreversible (131 . It is seen that the quality of the amplifier is directly related to the 
phosphorylation potential. In fact, when 7 = 1, i.e., ATP ^ ADP-i-Pi are in chemical equilibrium, 

^ aiki ^ d2q2 ^ ^^4^ 
aiki + diqi 02^2 + ^^292 1 + 

which is independent of a. In this case, the amplification is completely abolished. Biological amplification 

needs energy, just like a home stereo. 

The switch-like behavior in Fig. 1 can be understood semi-quantitatively as follows (Fig. 2). The kinase 

catalyzed phosphorylation reaction has a Michaelis-Menten constant KiWt and Vmax = Vi = kiEix- 



Therefore the overall rate of the reaction is j^j^ ; similarly the dephosphorylation reaction has a rate 
where V2 = k2E2T- The equilibrium constants for the respective reactions are /X7 = and = 
When Ki = K2 and o" = ^ S> 1, the phosphorylation pathway is dominant. Hence ^^^^ = ^7. When 
o" ^ 1, the pathway is dominated by dephosphorylation and = 11. Therefore, for a finite 7, one does not 
expect W* — > 1 as cj ^ 00, as clearly pointed out earlier in lfT3l . Rather we have W* TfJJFi as cj —> 00. 
For fi = 10^ and 7 = 10^, 10'^, 10^, and 10^*^, the plateau of W* toward right in Fig. 1 is expected to be 
0.099, i, and almost 1. 

The response coefficient, which characterizes the steepness of the transition in covalent modifica- 
tion, has been defined as the ratio of the a when W* = 90% to the a when W* = 10% 151. For a simple 
Michaelis-Menten kinetics its value is 8 1. A value of 1 means the transition is infinitely steep. With the finite 
7 and /i, in theory, because W* never exceeds 0.9 for a range of fi and 7 (Fig. 1), Ry needs to be redefined 
as the ratio of a when W* = 0.9W*{oo) + 0.1Ty*(-oo) to the a when W* = 0.9Ty*(-oo) + 0.1W*{oo), 
where W*{oo) = and I^*(-oo) = j^. In physiological reality, W*{oo) > 0.9 and I^*(-oo) < 0.1; 
that is ;U < 1/9 and /X7 > 9. Fig. 3 shows how the response coefficient, 

„ ^ - 9)(9^7 - + 0-l)(i^2 + 0-1) 

" - 9)(9/i - l){Ki + 0.9)(i^2 + 0.9) ^ ^ 

depends on the phosphorylation potential AG = RT In 7. It is seen that for the physiological range of AG, 
the steepness Ry reaches its minimal, platuea value given in |5 1. 

The current model in fact makes a prediction. Let W*{—oo) and W*{oo) be the left and right plateaus 
of the ampUfication curve in Fig. 1, which are very close to and 1, respectively. Then 

W*(-oo) W*(-oo) W*(oo) 1 

>^ TT.*/ N = - X = 7- (16) 



1-W*{qo) 1-W*{-oo) 1-H^*(oo) h 

In contrast, the previous model [5i predicts an indeterminate g. 

The steepness of the curves in Fig. 1 can also be characterized by the slope at its mid-point, known as 
Hill coefficient in the theory of allosteric cooperativity fHl . It can be obtained analytically from Eq. 

/ dW* \ 1/1 \ 

ny = -TT— ^-{fi + — + Ki + K2) (17) 

when Ki, K2, and fi are small and ^7 is large. We see again that the steepness increases with increasing 7. 



4 Temporal Cooperativity 

AUosteric change in and covalent modification of proteins are two most basic phenomena in cellular signal- 
ing processes |6|. While the equilibrium thermodynamic principle of the former is well understood |16|, 
relatively little attention has been given to the nonequilibrium steady-state thermodynamics ITTll of the latter. 
The analysis developed in the present paper indicates that the cooperativity in the cyclic reaction is temporal, 
with energy "stored" in time rather than in space as for the allosteric cooperativity. This concept is similar 
to the energy relay which was first proposed by J.J. Hopfield for understanding the molecular mechanism 
of kinetic proofreading in protein synthesis IfTSlfTOl . We now elaborate on this concept by carrying out a 
quantitative comparison between the steady-state system given in Eq. ^and the allosteric cooperativity. 

High-order versus zero-order reactions 

One of the most fundamental difference between allosteric cooperativity and zero-order ultrasensitivity 
is apparently the order of the reactions. Allosteric cooperativity is based on a reaction with high-order 

P + nL^ PLn (18) 

where K is the equilibrium constant for protein P binding single-ligand L. The corresponding fraction of 
protein with ligand then is 

\PLn] {KLY 
Y = = — ^ . (19) 

Eq. ^1 indicates that the steepness of the curve Y versus \-d.{K[L\) increases with n. On the other hand, 
ultrasensitivity is based on both phosphorylation and dephosphorylation reactions being enzyme limited; 
hence both have a very weak dependence on the respective substrate concentrations \W] and \W*]. In the 
steady-state 

kph[WY = kdp[W*Y (20) 

where kph and kdp are the rates of phosphorylation and dephosphorylation and v, the "order of the reaction", 
is near zero. (Normally the power term to the concentration of a species implies the stoichiometry of that 
species in a reaction. The meaning of v here is that the reaction is even less than first-order. Both a 
hyperbolic curve, as expected from an enzymatic reaction with saturation, and a curve with power < 1 are 
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concave down with negative curvature.) The corresponding fraction of protein in the activated state 



Eq. l2n indicates that the steepness of the curve Z versus Xxiikyhjk^p) increases with Xjv. Therefore, the 
optimal situation is a zero-order reaction with v = 

Surprisingly, allosteric binding (Eq. ITSl can yield an equation identical to d20t . Let equilibrium constant 
K = A;+/A;_ where kj^ and A;_ are association and dissociation rate constants. Then in the equilibrium 

{k+[L\Y[P] = k'liPLr,]. That is 

A:+[L][P]i/" = A;_[PL„]i/". (22) 

Temporal cooperativity in zero-order reaction cycle 

The cooperativity achieved by ultrasensitivity, therefore, can be stated as follows. It takes, on average, 
n„ = 1/u PdPCs in order to transform one W to W*. There is a temporal cooperativity on the scale of 
cycles. Therefore, Uy in time is analogous to the number of subunits in allosteric cooperativity (see Eqs. l20l 
andl^. Most importantly, transforming one W to one W* through multiple "futile" cycles is precisely the 
mechanism proposed by Hopfield for kinetics proofreading of protein biosynthesis (with branched reaction 
pathways) in which ^ 2 I181I19I . Multiple branched pathways have been proposed for kinetic proofread- 
ing in T-cell receptor signaling ll20l . Of course, the ATP hydrolysis is not futile, rather the energy supplies 
the need to maintain high accuracy and sensitivity or improved memory of a steady-state "living" system 
away from true thermodynamic equilibrium. 

The above statement can be further quantified. Let's consider a system with only a single Ei and a single 
E2 molecule, but n W substrate molecules. The complete kinetics of W* formation can be represented by 
a chain kinetic scheme shown in Fig. 4 1^ . which is a detailed version of what is shown in Q. Each time 
when a cycle is completed, one ATP molecule is hydrolyzed. The cooperativity of the kinetics in Fig. 4 is 
characterized by 



'i+l 



[n — i)a\ 



(i + 1)/?; 



^ + l + (23) 



n — z + nK\ 

For n completely independent W molecules undergoing W ^ W* transition, Eq. |55]is expected to be unity. 
However the n W molecules in Fig 4 are not independent since they are linked by the enzymatic reactions. 



For small Ki and K2, there is a cooperative phosphorylation when i > n/2 and there is a cooperative 
dephosphorylation when i < n/2. 

Fig 5 shows the steepness of the response curve for the model given in Fig. 4. The detailed model gives 
the same = 12.5 for Ki = K2 = 0.01. The significance of this chain model, however, is that it reveals 
the origin of the cooperativity l22ll . Furthermore, according to the theory of linear cooperativity l23ll22l . 
the steepness of the curves in Fig. 1 is directly related to the microscopic fluctuation in the the number of 
W*. 

Fig. 6 shows a numerical example of the reaction kinetics of the model given in Fig. 4. The large 
fluctuations in the number of W* molecules is directly related to the n^. In fact, ^J{{EW*Y) - y/nrh/, is 
expected to be 112. More cooperative system has larger fluctuations. 

5 Discussion 

The rigorous thermodynamic analysis of the model for phosphorylation-dephosphorylation cycle (PdPC) 
originally proposed in indicates that a sustained intracellular phosphorylation potential is essential in 
the functioning of the signal transduction process. This result suggests that the ubiquitous phosphorylation 
in biological signaling processes, in addition to the covalent chemical modification which leads to struc- 
tural recognition, also utilizes biochemical energy from the high-energy phosphate in order to carry out its 
function with high accuracy, robustness, sensitivity, and specificity fTHlfTTlE^ . The analysis also reveals a 
shared mechanism between the ultrasensitivity and kinetic proofreading in a large class of cellular processes 
involving GTPases fl^ . Both use cycle kinetics iTTIl to improve the power of biological selectivity. 

Our quantitative analysis also provided a clear mechanistic origin for the high cooperativity in the zero- 
order ultrasensitivity. A chain kinetic model indicates that the cooperativity is achieved through temporal 
cooperativity. This mechanism is parallel in mathematical form to, but fundamentally different in biochem- 
ical nature from, the allosteric cooperativity of multi-subunits protein systems 1151 . Both temporal and 
allosteric cooperativities have a deep connection to the molecular fluctuations as shown in Fig. 6 1^ . an 
insight largely unexplored in the studies of biological signal transduction processes. 

In order to compare our result with that of Goldbeter and Koshland, we have used the value Ki = K2 = 
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0.01 in this study. These values are extreme cases and many PdPCs studied in laboratory experiments show 
a much less cooperativity. With Km ~ 0.1 — l^M and concentrations of ~ 1/iM for the kinases in the 
MAPK pathway i8j|, the reahstic value will be ~ 0.1 — 1. The phosphatase concentration is even lower, 
~ InM. Note that from Eq. EJhigh cooperativity requires both K's for the kinase and the phosphatase to be 
small. The current model analysis also suggests that the source of phosphate in a PdPC, while chemically 
equivalent, could be important. A phosphate from ATP hydrolysis can be energetically different from a 
phosphate from GTP hydrolysis. In the cells, [ATP] ~ lOmM, [ADP] ~ lO/^M, [GTP] ~ ImM, [GDP] 
~ lOO/uM, and [Pi] ~ ImM (T5\ . Therefore, different cellular biochemical "batteries" can have different 
"voltages". 
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7 Figure Captions 

Figure 1. Amplified sensitivity of a phosphorylation-dephosphorylation cycle as a function of intracellular 
phosphorylation potential AG. From top to bottom, 7 = 10^°, 10^, 10^ and 10^, corresponding to AG= 13.8, 
5.5, 4.1, and 2.8 kcal/mol. IS.Skcal/mol is the typical value for intracellular phosphorylation potential 
flUflSl . Other parameters used in the computation: Ki = K2 = 0.01 and n = 0.001. 

Figure 2. A semi-quantitative, Michaelis-Menten, representation for the PdPC. The three numbers by 
each pathway are the equilibrium constant, forward and backward rates for the enzymatic reaction. They 
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satisfy their respective Haldane relationship for thermodynamic reversibility. In general the steady-state 
is between fx and jfx. If Vi ^ V2, then it is near and if V2 ^ Vi, it is near /z. When 7 > 1 the the 
PdPC runs clockwise. 

Figure 3. Intracellular phosphorylation potential, AG = RT Inj, in kcal/mol, controls the sensitivity 
amplification of a PdPC. The response coefficient is defined as (j{W* = 0.9)/a{W* = 0.1) in Fig. 1 
H. The solid line is for Ki = K2 = 0.01, and the dashed line for Ki = K2 = 0.1. Both with fi = 10"^. 

Figure 4. Detailed kinetic scheme showing how the PdPCs are being completed while n W molecules 
are transformed to W*. The "futile" cycles are indicated by Ji, J2, etc., and the net flux for W* formation 
is denoted by J*. According to Michaelis-Menten kinetics, transition rates Oj = i^^^^j^ and (3j = j^^^^, 
which are weakly substrate dependent when K's are small. ^ / ^ means cooperativity. The process 
is closely related to a biased random walk with J* and analogous to the "drift velocity" and "diffusion 
constant", respectively. 

Figure 5. The steepness rii, according to the kinetic model in Fig 4. First ^^^j^^^^^j is calculated as 
function of ln{ki/k2) with various Ki = K2 = K. The steepness, of the curve is the slope at its 
mid-point. Other parameters used: Eit = E2T = I, n = 1000. It can be analytically shown that for small 
K, ny = {n + 2)/12 = 83.5, and for large K, n„ = 1/4. For K = 0.01, n„ ^ 12.5 according to Ea.fTTl 

Figure 6. Upper pannel shows a numerical simulation of the reaction given in Fig. 4, with n = 1000, 
EiT = E2T = I, Ki = K2 = 0.01, ki = k2 = 100. Since cr = 1, the steady-state [W*] = 500. The large 
fluctuations in the number of W* molecules is directly related to the n^: ((AW^*)^) = y/nuy. Lower 
pannel shows the probability distributions for the number of W*. Solid flat line: a = 1.00, Dashed lines: 
different distributions for a = 0.97 and 1.03 respectively. We see a sharp response to a being less and 
greater than 1. In comparison, the central peak with dotted line is for non-cooperative system with 1000 
independent molecules and a = I. More cooperative system has larger fluctuations. 
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Figure 1 : Amplified sensitivity of a phosphorylation-dephosphorylation cycle as a function of intracellular 
phosphorylation potential AG. From top to bottom, 7 = 10^'', 10^, 10^ and 10^, corresponding to AG= 13.8, 
5.5, 4.1, and 2.8 kcal/mol. IS.Skcal/mol is the typical value for intracellular phosphorylation potential 
flUfTSll . Other parameters used in the computation: Ki = K2 = 0.01 and n = 0.001. 
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Figure 2: A semi-quantitative, Michaelis-Menten, representation for the PdPC. The three numbers by each 
pathway are the equilibrium constant, forward and backward rates for the enzymatic reaction. They satisfy 
their respective Haldane relationship for thermodynamic reversibility. In general the steady-state is 
between ji and 7/i. If Vi S> V2, then it is near 7/x, and if V2 3> Vi, it is near ii. When 7 > 1 the the PdPC 
runs clockwise. 
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Figure 3: Intracellular phosphorylation potential, AG = i?Tln7, in kcal/mol, controls the sensitivity 
amplification of a PdPC. The response coefficient R-a is defined as a{W* = 0.9) /a{W* = 0.1) in Fig. 1 
H. The solid line is for Ki = K2 = 0.01, and the dashed line for Ki = K2 = 0.1. Both with fi = 10"^. 
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Figure 4: Detailed kinetic scheme showing how the PdPCs are being completed while n W molecules are 
transformed to W*. The "futile" cycles are indicated by Ji, J2, etc., and the net flux for W* formation is 
denoted by J* . According to Michaelis-Menten kinetics, transition rates a, = ^1-^3^ and Bj = ^'^-^^t 

JO t L 1+nKi/t l+nK'z/j 

which are weakly substrate dependent when K's are small, / ^ means cooperativity. The process 
is closely related to a biased random walk with J* and analogous to the "drift velocity" and "diffusion 
constant", respectively. 
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Fi gure 5: The steepness n„ according to the kinetic model in Fig 4. First j ^ j ^ ^ Jj/, 
of ln(A;i/A;2) with various K\ = K2 = K. The steepness, n^, of the curve is the slope at its mid-point. 
Other parameters used: Eit = E2T = I, n = 1000. It can be analytically shown that for small K, 
n„ = (n + 2)/12 = 83.5, and for large K, = 1/4. For K = 0.01, Uy ^ 12.5 according to Eq. UT] 
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Figure 6: Upper pannel shows a numerical simulation of the reaction given in Fig. 4, with n = 1000, 
EiT = E2T = l,Ki = K2 = 0.01, ki = k2 = 100. Since a = l, the steady -state [W*] = 500. The large 
fluctuations in the number of W* molecules is directly related to the n^: a/ ((Al^*)^) = yjnn^. Lower 
pannel shows the probabihty distributions for the number of W*. Solid flat line: a = 1.00, Dashed lines: 
different distributions for a = 0.97 and 1.03 respectively. We see a sharp response to a being less and 
greater than 1. In comparison, the central peak with dotted line is for non-cooperative system with 1000 
independent molecules and cr = 1. More cooperative system has larger fluctuations. 
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